Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

🧐(api) remove old benchmark test data #260

Merged
merged 1 commit into from
Dec 4, 2024
Merged

🧐(api) remove old benchmark test data #260

merged 1 commit into from
Dec 4, 2024

Conversation

jmaupetit
Copy link
Member

Purpose

Now that every endpoint is tested in our performance tests, let's remove initial outdated data.

Proposal

  • remove first entries in data/bench.csv dataset

@jmaupetit
🧐(api) remove old benchmark test data
f24808b 
Now that every endpoint is tested in our performance tests, let's remove
initial outdated data.
@jmaupetit jmaupetit self-assigned this Dec 4, 2024
@jmaupetit jmaupetit added improvement API Item related to the API service labels Dec 4, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented Dec 4, 2024

Current benchmark

Type Name Request Count Failure Count Median Response Time Average Response Time Min Response Time Max Response Time Average Content Size Requests/s Failures/s 50% 66% 75% 80% 90% 95% 98% 99% 99.9% 99.99% 100% git timestamp version
GET /auth/whoami 26 0 700.0 716.5466245769167 28.30526999997573 1512.197386999958 160.0 0.90104486577281 0.0 740 880 900 900 1200 1400 1500 1500 1500 1500 1500 0ca153a 2024-12-04 17:06:49.959148+00:00 0.15.0
POST /dynamique/session/ 24 0 990.0 995.1134093333352 26.81900299995732 2281.372324000017 45.0 0.8317337222518246 0.0 1100 1100 1400 1400 1900 1900 2300 2300 2300 2300 2300 0ca153a 2024-12-04 17:06:49.959148+00:00 0.15.0
POST /dynamique/session/bulk 20 0 1100.0 1128.8776085000022 39.201562000016565 2411.936648000051 411.0 0.6931114352098539 0.0 1200 1400 1700 1700 1900 2400 2400 2400 2400 2400 2400 0ca153a 2024-12-04 17:06:49.959148+00:00 0.15.0
GET /dynamique/status/ 21 0 1100.0 1065.820401285713 23.995968999997785 2281.431656000052 285.0 0.7277670069703465 0.0 1100 1300 1700 1700 1800 2100 2300 2300 2300 2300 2300 0ca153a 2024-12-04 17:06:49.959148+00:00 0.15.0
POST /dynamique/status/ 30 0 850.0 908.3690537666636 11.184182999954828 2291.443360999949 45.0 1.0396671528147807 0.0 850 1100 1300 1700 2100 2100 2300 2300 2300 2300 2300 0ca153a 2024-12-04 17:06:49.959148+00:00 0.15.0
GET /dynamique/status/FRALLEGO002006P3 19 0 710.0 831.4618520000062 89.89295399999264 2055.6335869999884 283.0 0.6584558634493611 0.0 710 950 1300 1600 1700 2100 2100 2100 2100 2100 2100 0ca153a 2024-12-04 17:06:49.959148+00:00 0.15.0
GET /dynamique/status/FRALLEGO002006P3/history 19 0 990.0 1011.8373221578884 58.09251400000903 2145.9087349999777 56815.94736842105 0.6584558634493611 0.0 990 1200 1700 1800 2100 2100 2100 2100 2100 2100 2100 0ca153a 2024-12-04 17:06:49.959148+00:00 0.15.0
POST /dynamique/status/bulk 30 0 920.0 1047.6253523000007 28.48491899999317 2426.019815000018 411.0 1.0396671528147807 0.0 1100 1200 1600 1800 2100 2100 2400 2400 2400 2400 2400 0ca153a 2024-12-04 17:06:49.959148+00:00 0.15.0
POST /statique/ 20 3 920.0 1125.4548158500056 58.19979699998612 2283.21728100002 60.95 0.6931114352098539 0.103966715281478 920 1300 2100 2100 2300 2300 2300 2300 2300 2300 2300 0ca153a 2024-12-04 17:06:49.959148+00:00 0.15.0
GET /statique/?limit=10 27 0 1100.0 989.1930393333342 35.95374799999718 2751.3891290000174 13826.666666666666 0.9357004375333028 0.0 1100 1200 1600 1600 1700 2100 2800 2800 2800 2800 2800 0ca153a 2024-12-04 17:06:49.959148+00:00 0.15.0
GET /statique/?limit=100 30 0 1300.0 1191.2745572000006 149.18794200002594 2529.027516000042 129006.7 1.0396671528147807 0.0 1300 1300 1600 1800 2200 2300 2500 2500 2500 2500 2500 0ca153a 2024-12-04 17:06:49.959148+00:00 0.15.0
PUT /statique/FR073EP7QU5233 33 0 1100.0 1030.1055130302989 72.47810999996318 2264.8789239999587 1371.0 1.1436338680962588 0.0 1100 1200 1500 1600 1800 2200 2300 2300 2300 2300 2300 0ca153a 2024-12-04 17:06:49.959148+00:00 0.15.0
GET /statique/FRALLEGO002006P3 25 0 920.0 963.7848682399978 24.957137999990664 2282.2084800000084 1202.0 0.8663892940123172 0.0 920 1200 1300 1400 1600 2200 2300 2300 2300 2300 2300 0ca153a 2024-12-04 17:06:49.959148+00:00 0.15.0
POST /statique/bulk 29 0 1100.0 1231.3490883103514 399.2549970000141 2281.496026000013 1130.448275862069 1.005011581054288 0.0 1100 1700 1700 1800 2100 2200 2300 2300 2300 2300 2300 0ca153a 2024-12-04 17:06:49.959148+00:00 0.15.0
Aggregated 353 3 940.0 1019.6260720764876 11.184182999954828 2751.3891290000174 15498.076487252123 12.23341683145392 0.103966715281478 940 1200 1400 1600 1900 2200 2300 2400 2800 2800 2800 0ca153a 2024-12-04 17:06:49.959148+00:00 0.15.0

Comparison with the latest previous benchmark

A lower (negative) value means the current version performs better than the previous one.

Type Name Request Count Failure Count Median Response Time Average Response Time Min Response Time Max Response Time Average Content Size Requests/s
GET /auth/whoami 20 0 290.0 235.7343427435746 16.429832999961032 621.9288169999404 0.0 0.24465643843607254
POST /dynamique/session/ 19 0 948.0 787.0879515333357 17.53144099996007 1722.7260190000209 0.0 0.2847433661378769
POST /dynamique/session/bulk 12 0 1028.0 854.4592683749995 18.712933000017525 1102.7115490000483 0.0 -0.18207313457246266
GET /dynamique/status/ 16 0 1068.0 961.4476902857109 12.256156000006513 1873.915476000036 0.0 0.1807766508563987
POST /dynamique/status/ 23 0 768.0 749.7529967666543 -4.064699000053906 1837.3110389999567 0.0 0.27388065425525376
GET /dynamique/status/FRALLEGO002006P3 12 0 676.0 671.1538071428681 74.72751899999253 1258.73445900001 0.0 -0.10733063511016583
GET /dynamique/status/FRALLEGO002006P3/history 11 0 810.0 673.2207770328854 37.63203700000872 1337.1589689999723 39348.94736842105 -0.21672870633295538
POST /dynamique/status/bulk 24 0 878.0 884.7035861333344 7.9895410000005995 1741.848669000035 0.0 0.3832787254780433
POST /statique/ 17 3 857.0 1026.176463516658 10.54139299998269 2096.5163340000004 -7.049999999999997 0.36491722154148515
GET /statique/?limit=10 18 0 940.0 765.310043222216 -3.3068790000072568 2269.9907730000177 0.6666666666660603 -0.048882203471803165
GET /statique/?limit=100 21 0 890.0 769.8351575333303 2.2435280000081548 1355.1416290000304 0.6999999999970896 0.055084511809674774
PUT /statique/FR073EP7QU5233 29 0 1048.0 874.1072627803054 40.30708499996649 1800.1163529999644 0.0 0.7060415832051006
GET /statique/FRALLEGO002006P3 14 0 760.0 602.1345566036356 -2.6527859999987413 1097.9819430000077 0.0 -0.33698948943836804
POST /statique/bulk 22 0 560.0 532.9461151674974 -6.037594999980911 1106.4289730000205 17.87684729064017 0.23922508249476093
Aggregated 258 3 780.0 723.2276848449064 1.8966209999575767 1442.164030000015 102.47648725212275 1.8406000652889105

@jmaupetit jmaupetit merged commit 4cec15c into main Dec 4, 2024
23 of 24 checks passed
@jmaupetit jmaupetit deleted the remove-old-data branch December 4, 2024 17:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@jmaupetit jmaupetit

Labels
API Item related to the API service improvement
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@jmaupetit